U.S. S.N. 10/743,623 

AMENDMENTS TO THE CLAIMS 

1 . (Currently amended) A method of processing a digital image, each 
pixel of the digital image having only a single sampled value, the method 
comprising interpolating green values of a first co l or at pixels where green values 
were th e first co l or was not sampled, the interpolation of the f i rst color green 
value at a given pixel including: 

determining likelihoods of the given pixel belonging to the same region as 
each of at least two other pixels having sampled green values of th e f i rst color , 
the other pixels in different directions relative to the given pixel; [[and]] 

using the likelihoods and the sampled values of the other pixels to 
interpolate the green value first co l or at the given pixel ; and 

using sampled values of a second color to compute terms for correcting 
the interpolated green values . 

2. (Original) The method of claim 1 , wherein at least two of the 
directions are orthogonal. 

3. (Original) The method of claim 1 , wherein the directions include 
north, south, east and west of the given pixel. 

4. (Original) The method of claim 1, wherein the sampled pixel values 
are of neighboring pixels nearest the given pixel. 



5. (Cancelled) 
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6. (Currently amended) A method of processing a digital image, each 
pixel of the digital image having only a single sampled value, the method 
comprising interpolating values of a first color at pixels where the first color was 
not sampled, the interpolation of the first color value at a given pixel including: 

determining likelihoods of the given pixel belonging to the same region as 
each of at least two other pixels having sampled values of the first color, the 
other pixels in different directions relative to the given pixel; 

using the likelihoods and the sampled values of the other pixels to 
interpolate the first color at the given pixel; and 

using sampled values of a second color to compute terms for correcting 
the sampled values of the first color, including Th e m e thod of c l aim 5, wh e r ei n 
using-the samp le d va l u e s of th e second color to corr e ct a samp le d va l u e of th e 
first color includ e s taking a difference between the sampled value at the given 
pixel and the sampled value of the second color at a neighbor, the neighbor lying 
in the same direction as the pixel being corrected. 

7. (Original) The method of claim 6, wherein the likelihoods are used 
to compute a weighted average of the sampled values and correction terms. 

8. (Original) The method of claim 1 , wherein determining the 
likelihoods includes applying a similarity function to differences between sampled 
values. 

9. (Original) The method of claim 8, wherein determining the 
likelihoods includes using the differences to index a lookup table of precomputed 
likelihoods. 

1 0. (Original) The method of claim 1 , wherein the likelihoods are used 
to compute a weighted average of the sampled values. 
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11. (Cancelled) 

12. (Currently amended) The method of claim [[11]] 1, wherein missing 
green information (I G ) at a given pixel (i 9 j) is computed as 

£ {A[m (/, y ) - m(i + 2a, y + 2b)] + m(/ + a, y + b ('"> j) 
I. ft J) - ^ v , , : ■ 

(« > A)eA f 

where m{ij) is a sampled pixel value, a and b are components of a vector (a,b), 
X is a tunable parameter, TV is a neighborhood of pixels, and w a b are weights 
corresponding to the vector (a,b). 

1 3. (Original) The method of claim 1 2, wherein the weights w a h are 

computed as w ah (/, y) = p\m(i + 2a, j + 2b) - m(i 9 j)\ + |iw(/ + a, y + 6) - m(/ - a, j - b)\] , 
where p[] is a similarity function. 

14. (Original) The method of claim 1 , wherein the digital image 
corresponds to a Bayer CFA. 



15. (Cancelled) 
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1 6. (Currently amended) A method of processing a digital image, each 
pixel of the digital image having only a single sampled value, the method 
comprising interpolating values of a first color at pixels where the first color was 
not sampled, the interpolation of the first color value at a given pixel including: 

determining likelihoods of the given pixel belonging to the same region as 
each of at least two other pixels having sampled values of the first color, the 
other pixels in different directions relative to the given pixel: 

using the likelihoods and the sampled values of the other pixels to 
interpolate the first color at the given pixel: and 

Th e method of c l a i m 15, wher o in th e l ik el ihoods ar e us e d to i nt e rpo l at e 
m i ss i ng i nformat i on in on e color plan e , and wh e r ei n 

using bilinear interpolation i s us e d to interpolate missing information in 
other color planes, wherein the interpolation includes using sampled and 
interpolated green pixel values. 

1 7. (Currently amended) The method of claim [[1 5 11 1 , further 
comprising interpolating additional missing values of a second color , the 
interpolation of a second color value at the given pixel including: 

using sampled and interpolated green first co l or values to determine 
likelihoods of the given pixel belonging to the same region as neighboring pixels; 
and 

using the likelihoods and sampled second color values in the 
neighborhood to interpolate the second color value at the given pixel. 

1 8. (Currently amended) The method of claim 1 7, further comprising 
computing correction terms for correcting ; and us i ng th e corr e ct i on t e rms to 
corr e ct the interpolated sampl e d second color values in the neighborhood. 
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19. (Currently amended) The method of claim [[1 8]] 8, wherein a 
missing color value 7 c (ij) at pixel (i.j) is computed as 

£ [l G (i, j) - 1 G (/ + a, j + b) + m(/ + a, y + 6)] (/, y ) 

/ ( />y ) = 

where c e {/?,/?}, and 

{(-1,0),(1,0)}, 

{(0,-0,(0,1)}, 
{(-i-i),(-i,i)},{(i-i),(i,i)}, 



c = R, i is odd, j is even, or 

c = B, i is even, j is odd 
c = B, i is odd, j is even, or 

c = R, i is even, j is odd 
c = R, i is odd, j is odd, or 

c = B, i is even, j is even 



and 



ft J) = p\ ! g ('> J) " l o (' + <*> J + *)|] • 



20. (Currently amended) The method of claim [[1 5,U 1, further 
comprising wh e r ei n interpolating at least one of the other missing colors^ 
including i nc l ud e s : 

making an initial estimate for the other missing colors; 

transforming an output image into a luminance-chrominance color space, 
the output image including sampled and interpolated values of the first color, and 
sampled values of the other colors; 

smoothing the luminance and chrominance bands; 

transforming the output image back to its original color space; and 

resetting m e asur e d sampled values and green interpolated values in the 
output image 

21 . (Previously presented) The method of claim 20, wherein each step 
is a linear operation, and wherein the steps are performed by applying a 
concatenation of the linear operations to the output image. 
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22. (Currently amended) A method of processing a digital image, each 
pixel of the digital image having only a single sampled value, the method 
comprising interpolating values of a first color at pixels where the first color was 
not sampled, the interpolation of the first color value at a given pixel including: 

determining likelihoods of the given pixel belonging to the same region as 
each of at least two other pixels having sampled values of the first color, the 
other pixels in different directions relative to the given pixel; 

using the likelihoods and the sampled values of the other pixels to 
interpolate the first color at the given pixel; and 

Th e method of cla i m 15, wh e r ei n performing affine interpolation of at least 

one other color of th e oth e r co l ors is p e rform e d as 

h 0> y) = tj, e (*> y)h (*> y) + ^ dc y) 

where l d is the color to be interpolated at pixel coordinates (x,y), l c is either the 
green sampled value or the green interpolated value, s d , c is a slowly varying 
function of a shift in color c, and t d , c is a slowly varying function that can change 
an intensity gradient. 

23. (Currently amended) Apparatus comprising a processor for 
interpolating missing values in a first color plane of a mosaic image, the 
interpolation of a given pixel in the color plane including: 

determining likelihoods of neighbors belonging to the same region as the 
given pixel, the neighbors having sampled values of the first color, at least two of 
the neighbors lying in different directions relative to the given pixel; [[and]] 

using the likelihoods and the sampled values to interpolate a first color 
value for the given pixel ; and 

using sampled values in a second color plane to compute correction terms 
for the interpolated values in the first color plane, including taking a difference 
between the sampled value at the given pixel and a sampled value in the second 
color plane at a neighbor, the neighbor lying in the same direction as the 
sampled value being corrected . 
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24. (Cancelled) 

25. (Cancelled). 

26. (Currently amended) The apparatus of claim [[25 ]] 23 , wherein the 
likelihoods are used to compute a weighted average of the sampled values and 
the correction terms. 

27. (Original) The apparatus of claim 23, wherein determining the 
likelihoods includes applying a similarity function to differences between sampled 
values. 

28. (Original) The apparatus of claim 23, wherein the first color is 
green, whereby missing information in a green color plane is interpolated. 

29. (Original) The apparatus of claim 23, wherein the processor also 
interpolates at least one other missing color value at each pixel. 

30. (Original) The apparatus of claim 23, wherein the processor further 
interpolates a second color plane, the interpolation of a second color value at the 
given pixel including: 

using sampled and interpolated first color values to determine likelihoods 
of the given pixel belonging to the same region as neighboring pixels; and 

using the likelihoods and sampled second color values in the 
neighborhood to interpolate the second color value at the given pixel. 

31 . (Previously presented) The apparatus of claim 23, wherein the 
processor further interpolates additional color planes, the interpolation of the 
additional color planes including: 
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making an initial estimate for missing information in the additional color 
planes; 

transforming an output image into a luminance-chrominance color space, 
the output image including sampled and interpolated values of the first color, and 
sampled values of the other colors; 

smoothing the luminance and chrominance bands; 

transforming the output image back to its original color space; and 

resetting measured values and green interpolated values in the output 

image. 

32. (Currently amended) The apparatus of claim 23, wherein the 
processor further interpolates a second color plane, the interpolation of a second 
color value of a ai4fre-given pixel at pixel coordinates (x,y) performed according 
to: 

h 0> ; ; ) = h 9 e 0> y) J c ( x > y) + ^ 0> y) 

where Id is the second color value, l c is either the green sampled value or the 
green interpolated value at pixel coordinates (x,y), Sd, c is a slowly varying 
function of a shift in color c, and t d , c is a slowly varying function that can change 
an intensity gradient. 

33. (Currently amended) Apparatus for processing a mosaic image, the 
apparatus comprising: 

means for using sampled values in a rrcolor ll green plane of the mosaic 
image to determine the likelihoods of a given pixel belong to the same region as 
at least two different neighbors lying in different directions; and 

means for using the likelihoods., [[and]] sampled values in the different 
directions , and correction terms to interpolate a value at the given pixel, the 
interpolated value being in the green rr colorll plane , the correction terms 
computed from non-green sampled values . 
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34. (Original) The apparatus of claim 33, further comprising means for 
aquiring the mosaic image. 

35. (Currently amended) A digital camera comprising: 
a photosensor array for acquiring mosaic images; and 

a digital signal processor for processing the mosaic images, the 
processing including interpolating missing values from sampled values in the 
mosaic image, the interpolation of a green value of a given pixel i n a giv e n co l or 
plane including determining the likelihoods of neighbors belonging to the same 
region as the given pixel, the neighbors being in at least two different directions 
relative to the given pixel; Hand]] using the likelihoods , a correction term and the 
sampled values of the neighbors to interpolate the green value th e giv e n co l or at 
the given pixel ; the correction term computed from neighboring sampled values 
of a second color and also from the likelihoods . 

36. (Cancelled) 

37. (Currently amended) An article for instructing a processor to 
process a mosaic image, the article comprising memory encoded with 
instructions for instructing the processor to interpolate missing green values-ef-a 
first co l or , the interpolation of a green value th e first color of a given pixel 
including determining likelihoods of neighbors having sampled green values of 
th e f i rst color being in the same region as the given pixel, and using correction 
terms, the sampled values and the likelihoods of those neighbors to interpolate 
the green value f i rst color at the given pixel, at least one neighbor being in a first 
direction relative to the given pixel, at least one neighbor being in a second 
direction relative to the given pixel, where the first and second directions are 
orthogonal ; the correction terms computed from sampled non-green values of 
neighboring pixels and also from the likelihoods . 

38. (Cancelled) 
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